arXiv:1504.01456vl [cs.IT] 7 Apr 2015 


Local Measurement and Reconstruction for Noisy Graph 

Signals 


Xiaohan Wang, Jiaxuan Chen, and Ynantao Gn* 
Submitted April 5, 2015 


Abstract 

The emerging field of signal processing on graph plays a more and more impor¬ 
tant role in processing signals and information related to networks. Existing works 
have shown that under certain conditions a smooth graph signal can be uniquely recon¬ 
structed from its decimation, i.e., data associated with a subset of vertices. However, 
in some potential applications (e.g., sensor networks with clustering structure), the ob¬ 
tained data may be a combination of signals associated with several vertices, rather than 
the decimation. In this paper, we propose a new concept of local measurement, which is 
a generalization of decimation. Using the local measurements, a local-set-based method 
named iterative local measurement reconstruction (ILMR) is proposed to reconstruct 
bandlimited graph signals. It is proved that ILMR can reconstruct the original signal 
perfectly under certain conditions. The performance of ILMR against noise is theoreti¬ 
cally analyzed. The optimal choice of local weights and a greedy algorithm of local set 
partition are given in the sense of minimizing the expected reconstruction error. Com¬ 
pared with decimation, the proposed local measurement sampling and reconstruction 
scheme is more robust in noise existing scenarios. 

Keywords: Signal processing on graph, graph signal, sampling, local measurement, 
iterative reconstruction. 


1 Introduction 

In recent years, graph-based signal processing has become an active research field due to 
the increasing demands for signal and information processing in irregular domains BE]. 
For an A-vertex undirected graph Q(V,£), where V denotes the vertex set and £ denotes 
the edge set, if a real number is associated with each vertex of Q, these numbers of all the 
vertices constitute a graph signal f E M^. Potential applications of graph signal processing 
have been found in areas including sensor networks [3], semi-supervised learning [4], image 
processing [5], and structure monitoring [6]. 

*The authors are with Department of Electronic Engineering, Tsinghua University, Beijing 100084, P. R. 
China. The corresponding author of this work is Yuantao Gu (e-mail: gyt@tsinghua.edu.cn). 
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A lot of concepts and techniques for classical signal processing are extended to graph 
signal processing. Related problems on graph include graph signal filtering mu, graph 
wavelets piniiii] , graph signal compression [El US], uncertainty principle m, graph signal 
coarsening [T^lfTC] . multiresolution transforms HZIIIHI, parametric dictionary learning m, 
graph topology learning 123, graph signal sampling and reconstruction 1211E2 ESI EH, and 
distributed algorithms [251 IMj . 

1.1 Motivation and Related Works 

It is a natural problem to reconstruct smooth signals from partial observations on a graph 
in practical applications [ZllElEll. For data gathering in sensor networks, sometimes only 
part of the nodes transmit data due to the limited bandwidth or energy. According to the 
smoothness of data, the missing entries can be estimated from the received ones, which 
can be modeled as the reconstruction of smooth signals on graph from decimation. Espe¬ 
cially, for a sensor network with clustering structure, the collected data within a cluster are 
aggregated by the cluster head, which plays the role as a local measurement and can be 
naturally obtained. Using the measured data from all the clusters to retrieve the raw data 
of all the nodes can be modeled as a problem of smooth graph signal reconstruction from 
local measurements, which is a linear combination of the signal amplitudes in a cluster of 
vertices. This problem is studied in this work for the first time. 

There have been several works focusing on the theory of exactly reconstructing a ban- 
dlimited graph signal from its decimation. Sufficient conditions for unique reconstruction 
of bandlimited graph signals from decimation are given for normalized [28] and unnormal¬ 
ized Laplacian [29]. In EU, a necessary and sufficient condition on the cutoff frequency 
is established and the bandwidth is estimated based on the concept of spectral moments. 
Several algorithms are proposed to reconstruct graph signals from decimation. In [22], an 
algorithm named iterative least square reconstruction (ILSR) is proposed and the trade¬ 
off between data-fitting and smoothness is also considered. Two more efficient algorithms 
named iterative weighting reconstruction (IWR) and iterative propagating reconstruction 
(IPR) are proposed in [2l] with much faster convergence. 

As far as we know, there is no work on reconstructing graph signals from local mea¬ 
surements. The idea of local measurements can be traced back to time-domain nonuniform 
sampling m, or irregular sampling iniE2], which has a close relationship with graph sig¬ 
nal sampling and reconstruction. For the signals in time-domain 133 EH, shift-invariant 
space [31] , or on manifolds [33131], based on the theoretical results of signal reconstruction 
from samples, there has been extended works on reconstructing signals from local averages. 
However, there is no such work on graph-signal-related problems. 
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1.2 Contributions 


In this paper, we first generalize the sampling scheme for graph signals from decimation to 
local measurement. Based on this scheme, we then propose a new method named iterative 
local measurement reconstruction (ILMR) to reconstruct the original signal from limited 
measurements. It is proved that the bandlimited signals can always be exactly reconstructed 
from its local measurements if certain conditions are satisfied. Moreover, we demonstrate 
that the traditional decimation scheme, which samples by vertex, and its corresponding 
reconstruction method is a special case of this work. Based on the performance analysis of 
ILMR, we find that the local measurement is more robust than decimation in noise scenario. 
As a consequence, the optimal local weights in different noisy environment are discussed. 
The proposed sampling scheme has several advantages. First, it will benefit in the situation 
where local measurements are easier to obtain than the samples of specific vertices. Second, 
the proposed local measurement and reconstruction is more robust against noise. 

This paper is organized as follows. In section II, the basis of graph signal processing and 
some existing algorithms for reconstructing graph signals from decimation are reviewed. The 
generalized sampling scheme, i.e. local measurement, is proposed in section III. In section 

IV, the reconstruction algorithm ILMR is proposed and its convergence is proved. In section 

V, the reconstruction performance in noise scenario is studied, and the optimal choice of 
local weight and local set partition is discussed. Experimental results are demonstrated in 
section VI, and the paper is concluded in section VII. 

2 Preliminaries 

2.1 Laplacian-based Graph Signal Processing and Bandlimited Graph 
Signals 

The Laplacian m of an V-vertex undirected graph Q is defined as 

L = D-A, 

where A is the adjacency matrix of and D is the degree matrix, which is a diagonal 
matrix whose entries are the degrees of the corresponding vertices. 

Since G is undirected, its Laplacian is a symmetric and positive semi-definite matrix, 
and all of the eigenvalues of L are real and nonnegative. If G is connected, there is only 
one zero eigenvalue. Denote the eigenvalues of L as 0 = Ai < A 2 < • • • < Aw, and the 
corresponding eigenvectors as {uk}i<k<N- The eigenvectors can also be regarded as graph 
signals on G- 

The Laplacian L : ^ is an operator on the space of graph signals on 

(Lf)(«) = (/(«) - f{v)) , V« G V, 

vGV^u^v 
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where f{u) denotes the entry of f associated with vertex and u ^ v denotes that there 
is an edge between vertices u and v. The Laplacian can be viewed as a kind of differen¬ 
tial operator between vertices and their neighbors. Therefore, among the eigenvectors of 
L, those associated with small eigenvalues have similar amplitudes on connected vertices, 
while the eigenvectors associated with large eigenvalues vary fast on the graph. In other 
words, eigenvectors associated with small eigenvalues are smooth or denote low-frequency 
components of signals on Q. 

For graph Fourier transform m, the eigenvectors are regarded as the Fourier 

basis of the frequency-domain, and the eigenvalues are regarded as frequencies. 

The graph Fourier transform is 

N 

f{k) = (f,Ufc) = 

i=l 

where f{k) is the strength of frequency Xk- 

Similar to its counterpart in time-domain, if a graph signal f is smooth on f may be 
uniquely determined by its entries on a limited number of sampled vertices. Based on the 
graph Laplacian, the smoothness of a graph signal is usually described as being within a 
bandlimited subspace. A graph signal f G is cj-bandlimited if 

f G PW^{Q) = span{ui|A^ < cj}, 

which is called Paley-Wiener space on Q [28] . 

2.2 Reconstruction from Decimation of Bandlimited Graph Signals 

There have been theoretical analysis and algorithms on the reconstruction from decimation 
of bandlimited graph signals. Existing results show that f G PWuj{Q) can be uniquely 
reconstructed from its entries {f{u)}ueS on n sampling vertex set 5 C V under certain 
conditions. An important concept of uniqueness set is introduced in [28] . 

Definition 1 (uniqueness set [^j) A set of vertiees S C V{G) is a uniqueness set for 
spaee PW^^{Q) if it holds for all f,g G PW^{G) that f{u) equals g{u) for all u ^ S implies 
f equals g. 

Then iterative least square reconstruction (ILSR), a reconstruction algorithm from dec¬ 
imation of graph signal is proposed, which can be written in the following equivalent form. 


Theorem 1 (ILSR [22] I If the sampling set S is a uniqueness set for PW^{Q), then the 
original signal f ean he reeonstrueted using the deeimation {f{u)}ueS by the following ILSR 
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method, 


\ues J 


f(^=+i) ^ fW + 5](/(n) - f^^\u))6u , 

\ues / 


where Vuj{') is the projeetion operator onto PW^{Q), and du is a Dirae delta funetion whose 
entries satisfying 


K{v) 


1, V = U] 
0, V ^ u. 


( 1 ) 


To accelerate the convergence, an algorithm named iterative propagating reconstruction 
(IPR) is proposed, which is based on an important concept of loeal sets. 


Definition 2 (local sets 121!) For a sampling set S on a graph Q{y,£), assume that V 
is divided into disjoint loeal sets {A/’(i^)}nG<S assoeiated with the sampled vertiees. For eaeh 
u ^ S, denote the subgraph of Q restrieted to M{u) by GAf{u)^ whieh is eomposed of vertiees 
in and edges between them in £. For eaeh u ^ S, its loeal set satisfies u G M{u), and 

the subgraph Gj\f{u) i^ conneeted. Besides, {A/’(i^)}nG<S should satisfy 

1^ J\f{u) = V and J\f{u) H J\f{v) = 0, Vi^, v ^ S,u ^ v. 

u^S 

The property of a local set is measured by maximal multiple number and radius, as 
follows. 


Definition 3 (maximal multiple number |24| ) Denoting T{u) as the shortest-path tree 
of GAT(u) 'tooted at u, for v ^ u in T{u), Tu{v) is the subtree eomposed by v and its deseen- 
dants in T{u). The maximal multiple number of J\f{u) is 

K{u) — max \Tu{v)\. 

v^u in T{u) 

Definition 4 (radius |24| ) The radius ofJ\f{u) is the maximal distanee of vertex in Gj\f{u) 
from u, denoted as 

R{u) — max dist{v,u). 

Theorem 2 (IPR j24j) For a given sampling set S and assoeiated loeal sets 
on a graph GiV^S), Vf G FWuj{G), ifov is less than 1/Qmax; f reeonstrueted by its 

deeimation {f{u)}ueS through the IFR method 

\u^S 

f(fc+i) = f(fc)+ 
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where 


Qrnax = max ■s/K{u)R{u), 
uGS 

and denotes the graph signal with entries 




1, veJ\f{u)] 

0 , 


IPR converges faster than ILSR, because in each iteration, IPR updates a larger increment 
than ILSR by utilizing a propagation to local sets. 


3 Local Measurement: A Generalized Sampling Scheme 

We consider a new sampling scheme of measuring by local sets. In this scheme, all the 
vertices in a graph is partitioned into disjoint clusters. In each cluster, there is no specific 
sampling vertex, but all vertices in this cluster contribute to produce a measurement. For 
this purpose, eenterless loeal sets are first introduced based on Definition 

Definition 5 (centerless local sets) For a graph QiV^S), assume that V is divided into 
disjoint loeal sets where X denotes the index set of divisions. Eaeh subgraph 

whieh denotes the subgraph of G restrieted to J\fi, is eonneeted. Besides, {J\fi}iex should 
satisfy 

= V and = 0, Vi, j G X, i / j. 

iex 

One should notice that the centerless local sets play important roles in the proposed 
generalized sampling scheme, while the local sets do not in traditional decimation scheme. 
In the decimation scheme, the local sets are designed for specific reconstruction algorithms 
and have no effect in the sampling process. However, in the generalized sampling scheme, 
the centerless local sets are elaborated for sampling and determine the performance of 
reconstruction, which will be discussed in section 

To evaluate the partition of a graph, the diameter of a centerless local set is defined and 
will be utilized in next section. 

Definition 6 (diameter) For a eenterless loeal set J\fi, its diameter is defined as the 
largest distanee of two vertiees in GMi^ ^*6.; 

Di = max dist{u,v). 

In order to produce a measurement from specific centerless local set, a loeal weight is 
defined to balance the contribution of all vertices in this set and to obstruct the energy from 
other part of the graph. 
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Figure 1: An illustration of traditional sampling (decimation) scheme versus generalized 
sampling (local measurement) scheme. For each centerless local set, a local measurement is 
produced by a linear combination of signal amplitudes associated with vertices within this 
set. 


Definition 7 (local weight) A local weight G associated with a centerless local set 
Mi satisfies 


^iiv) 


>0,veMi 

^0,v ^ Mi 


and 

^i{v) = 1- 

veAfi 


We highlight that the weight is local rather than global comes from some natural ob¬ 
servations. It is partially because that locality and local operations are basic features of 
graphs and complex networks. Moreover, signal processing on graph may be dependent on 
distributed implementation, where local operations are more feasible than global ones. 

Finally, we arrive at the definition of local measurement by linearly combining the signal 
amplitudes in each centerless local set using preassigned local weights. 


Definition 8 (local measurement) For given centerless local sets and the associated lo¬ 
cal weights {{Mi^ ipi)}i^x, cl set of local measurements for a graph signal f is {fcp-}iei^ where 

Ui - 

veAfi 

The sampling schemes of decimation and of local measurement are visualized in Fig. 
Compared with decimation in previous works ISIEH], local measurement can be regarded 
as a generalized sampling scheme. The local measurement {fipf\iex is to obtain a linear 
combination of the signal in each local set, while the decimation {f{u)}ueS is to obtain the 
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signal on selected vertices in the sampling set S. Both sampling schemes take the inner 
products of the original signal and specified local weights. Decimation can be regarded as a 
special case of local measurement, with all the weights in each centerless local set assigned 
to only one vertex, i.e., the sampled vertex. 


4 ILMR: Reconstruct Signal from Local Measurements 


We will show that under certain conditions the original signal f can be uniquely and exactly 
reconstructed from the local measurements {fip-}ieX‘ 

First of all, an operator is defined based on centerless local sets and the associated local 
weights. 

Definition 9 For given centerless local sets and the associated weights {{Mi^g:>i)}iex on a 
graph QiV^E), an operator G is defined by 


where Sj\f. is defined as 


Gf = 



= j2{e<Pi)vusM,), 

iex 


SAfiiv) 


1, V E: Mi'j 
0, V ^ Mi- 


( 2 ) 

(3) 

(4) 


For a graph signal, the proposed operator is to calculate the local measurement in each 
centerless local set, then to assign the local measurement to all the vertices in that set, and 
finally to filter out the component beyond the bandwidth, i.e., (§. Equivalently, it denotes 
a linear combination of all low-frequency part of with the combination coefficients 

as the local measurements of corresponding local sets, i.e., (§. 

The following lemma shows that the proposed operator is bounded in PWuj{Q) under 
certain conditions. 


Lemma 1 For given centerless local sets and the associated weights {{Mi^(pi)}iex, Vf G 
PW^^{Q), the following inequality holds, 


where 

Gmax ~ max \/\J\fi\F)i, 

and I • I denotes cardinality. 


The proof of Lemma is postponed to section 8T Lemma shows that the operator 
(I — G) is a contraction mapping in PWijj{Q) if uj is less than 1/G^ax- 




Table 1: Iterative Local Measurement Reconstruction. 


Input: Graph cutoff frequency cj, centerless local sets 

local weights local measurements 

Output: Interpolated signal 

Initialization: 

= (5) 

Loop: 

( 6 ) 

Until: The stop condition is satisfied. 


Based on Lemma it is shown in Proposition that the original signal can be recon¬ 
structed from its local measurements. 

Proposition 1 For given centerless local sets and the associated weights {{J\fi^(pi)}iex, 
Vf G PWuj{G), where u is less than f reconstructed from its local measure¬ 

ments {fip-}iex through an iterative local measurement reconstruction (ILMR) algorithm in 
Table\I\ with the error at the kth iteration satisfying 


where 

T ~ C^maxV^* (^) 

Proof According to the definition of G, the iteration (H) can be rewritten as 

f(^+i) = #)+ G(f-#)). (8) 

Note that f G PW^{g) and G PW^{g) for any k, then f('^) - f G PW^{g). As a 
consequence of Lemma 

||#+i) - f|| = ||(fW - f) - G(#) - f)|| < - f||. 

Proposition [l] shows that a signal f is uniquely determined and can be reconstructed 
by its local measurements {fip^}ieT if {<^0 i^x are known. The quantity {f^p. — is 

the estimate error between the original measurement and the reconstructed measurement 
at the fcth iteration. According to Q, in each iteration of ILMR, the new increment of 
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the interpolated signal is obtained by first assigning the estimate error to all vertices in the 
associated centerless local sets, and then projecting it onto the cj-bandlimited subspace. 

Except for the difference of decimation and local measurement, the basic idea of ILMR 
is similar to that of IPR which is an algorithm of reconstructing graph signal from 
decimation. The procedures of IPR and ILMR in each iteration are illustrated in Fig. 

One may find that in the assignment or propagating step, ILMR assigns the estimate 
errors of local measurements to vertices within the local sets, while IPR propagates the 
estimate errors of the decimated signal on the sampled vertices to other vertices in the local 
sets. In fact, ILMR degenerates to IPR if the local weight concentrates on only one vertex 
(the sampled vertex) in each local set, in which case the local measurement degenerates to 
decimation. 

The sufficient conditions and error bounds for ILMR and IPR are also different. Suppose 
the (centerless) local sets divisions in ILMR and IPR are exactly the same, i.e. the sampling 
set S in IPR can be written as {ui}i^x^ where X is the index set in ILMR, then J\fi equals 
M{ui) for all i G X. According to Definition and we have R{ui) < Di and K{ui) < 
\J\f{ui)\ — \J\fi\. Therefore, Cmax is not less than Qmax- It implies that a more strict 
condition is needed to reconstruct a graph signal accurately from local measurements than 
to reconstruct it from decimation. However, since both sufficient conditions in Theorem 
and Proposition are not tight and there is still room for refinement, such a comparison 
only provides a rough analysis. 

Remark 1 For potential applications, if the local measurements come from the result of 
some repeatable physical operations, the local weights are even not necessarily known when 
conducting ILMR. In detail, if {g^i}iex is unknown hut fixed, i.e., the local measurement 
operation in Fig. is a black box, ,(^i) may also he obtained by conducting the 

physical operations in each iteration. Therefore, the original signal can still he reconstructed 
by ILMR without exactly knowing This is a rather interesting result, and may 

facilitate graph signal reconstruction in specific scenarios. 

5 Performance Analysis 

In this section, we study the error performance of ILMR when the original signal is cor¬ 
rupted by additive noise. We first derive the reconstruction error for incorrect measurement. 
Then the expected reconstruction error is calculated under the assumption of independent 
Gaussian noises and the optimal local weight is obtained in the sense of minimizing the 
expected reconstruction error bound. Finally, in a special case of i.i.d. Gaussian pertur¬ 
bation, a greedy method for the centerless local sets partition and the selection of optimal 
local weights are provided. 
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Figure 2: The procedures of IPR and ILMR. The former algorithm is to reconstruct a 
bandlimited signal from decimation, while the latter reconstructs a signal from local mea¬ 
surements. Essentially, ILMR becomes IPR if the local weights concentrate on only one 
vertex of each local set, in which case local measurement degenerates to decimation. 


5.1 Reconstruction Error in Noise Scenario 

Suppose the observed signal associated with each vertex is corrupted by additive noise. The 
corrupted signal is denoted as f = f + n, where n denotes the noise. In the kth iteration of 
ILMR, the corrupted local measurements {{f,(pi)}i^x is utilized to produce the temporary 
reconstruction of 

The following lemma gives a reconstruction error bound of . 

Proposition 2 For given centerless local sets and the associated weights 
f G PW^{Q) is corrupted by additive noise n. If uj is less than 1/Cmax; iteration 

the output of ILMR using the corrupted local measurements {(f, satisfies 

l|fm_f|l<^ + /+i(llf|l + ll„ll), (9) 

1-7 

where 7 is defined as &, h is defined as 

( 10 ) 

iex 
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and Ui is the equivalent noise of eenterless loeal set J\fi, defined as 

Hi = {n,(pi) = ^ n{v)(pi{v). (11) 

veAfi 

The proof of Proposition is postponed to section 
From Q it can be seen that in the noise scenario the reconstruction error in controlled 
by the sum of two parts. The former one is a weighted sum of the equivalent noise of all 
the local sets, while the latter one is decaying with the increase of iteration number. The 
former part is crucial as the iteration goes on. Thus minimizing the former part, which is 
determined by both partition of centerless local sets and local weights, may improve the 
performance of ILMR in the noise scenario. 


8.2 


5.2 Gaussian Noise and Optimal Local Weights 


For a given partition {Afi}iex^ some prior knowledge of unknown noise n may bring the 
possibility to design optimal local weights. For simplicity the noises associated with different 
vertices are assumed to be independent. 

Suppose the noise follows zero-mean Gaussian distribution, i.e., n ^ A/"(0, E), where Xl 
is a diagonal matrix and the noise of vertex v satisfies n{v) ^ A/"(0, cr^('?;)). Then n defined 
in ( 10 ) is a random variable. 

For centerless local set A/’i, according to 0 , the equivalent noise Ui also follows a 
Gaussian distribution Ui ^ A/"(0,(j|), where 


veAfi 

Then |n^| follows the half-normal distribution with its expectation satisfying 


( 12 ) 


E{|ni|} = ai\l 


According to (10), the expectation of h is 




(13) 


iex 


Then the following corollary is ready to obtain. 


Corollary 1 For given eenterless loeal sets and the assoeiated weights {{J\fi^^i)}iex, the 
original signal f G PWuj{Q), assuming the noise assoeiated with vertex v follows independent 
Gaussian distribution ifcu is less than the expeeted reeonstruetion error 

of ILMR in the kth iteration satisfies 


E { Ilf- f II} < ^ vf ^ ° 

' iex 


where 7 is defined as &. and Gi is defined as ( fl^ . 


( 14 ) 
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Corollary is ready to prove by plugging (12) and (13) in the expectation of 
By minimizing the right hand side of (14), the optimal choice of local weight^ can be 
derived. 


Corollary 2 For given division of centerless local sets {J\fi]iex, if the noises associated 
with the vertices are independent and follow zero-mean Gaussian distributions n{v) ^ 
A/’(0, then the optimal local weights {(^i}iex 

" (15) 

0, V ^ Mi- 


^i{v) = < 


Proof Minimizing the right hand side of (14) is equivalent to minimizing gi for each local 


set Mi. By the Cauchy-Schwarz inequality, one has 


} \v&Mi I \v&Mi } \v&J\fi 


= 1 . 


Therefore, 


erf > 


The equality of (16) holds if and only if ( [T^ is satisfied. 


(16) 


The above analysis shows that in the sense of minimizing the expected reconstruction 
error, the optimal local weight associated with vertex v within Mi is inversely proportional 
to the noise variance of v. This is evident because more information are reserved in the 
sampling process if a larger local weight is assigned to a vertex with smaller noise variance. 
However, it should be noted that compared with the optimal local measurement, assigning 
all the weights in Mi to the vertex with the smallest noise variance, i.e. the optimal decima¬ 
tion, is not the best choice. In fact, the optimal choice of local measurements is consistent 
with the well-known inverse variance weighting in statistics [38] . 

Therefore, local measurement may reduce the disturbance of noise and reconstruct the 
original signal more precisely. In other words, for given partition of centerless local sets, 
graph signal reconstruction from local measurements with the optimal weights may always 
perform better than reconstruction from decimation, even when the vertices with the small¬ 
est noise variance are chosen in the latter sampling scheme. 


5.3 A Special Case of Independent and Identical Distributed Gaussian 
Noise 

Specifically, if the noise variances are the same for all the vertices, i.e., a{v) equals a for 
any 'u G V, n can be approximately written in a more explicit form. For Mi^ the optimal 

^In fact, the optimal local weights can also be studied in other criterions, e.g. the fastest convergence. 
However, in this work we only consider in the sense of minimizing the expected reconstruction error bound. 
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local weight is equal for all the vertices in J\fi. Thus (■Pi{v) equals l/IA/”^! for v ^ J\fi^ and in 
this case, ^/\Mi\ni follows a Gaussian distribution, 


\/Wi\ni ~ A/'(0,cr^). 


Then ^\M~\ • \ni\ follows the half-normal distribution with the same parameter a. The 
above analysis shows that each term of the sum in (10) follows independent and identical 
half-normal distribution, with its expectation and variance satisfying 


E 


Var 


{^/w:\ 

{vTmI- l«il) 


\ni\ } = (JM -, 
TT 


(J 


1 - 


TT 


Because the number of local sets |X| is always relatively large, by the central limit theorem, 
h follows a Gaussian distribution approximately. 


h ~ A/" ( \I\a\l-, \I\a^ 


1 -- 

TT 


Then we have the following corollary. 


Corollary 3 For given centerless local sets {J\fi}iex ci^d the associated weights (pi{v) = 
l/IA/"^! for V ^ J\fi, the original signal f G PW^{Q), assuming the noise associated with each 
vertex follows i.i.d Gaussian distribution if uj is less than the expected 

reconstruction error of ILMR in the kth iteration satisfies 

Ejiifw-tiijs^vf+oe^‘)' 

where 7 is defined as &■ 

According to 0, the error bound is affected by the number of centerless local sets 
\I\. A division with fewer sets may reduce the expected reconstruction error. However, it 
should be noted that the number of centerless local sets cannot be too small to satisfy the 
condition 

7 = C'maxA/w = max y/\Mi\DiUJ < 1, 

iex 

which is determined by the cutoff frequency of the original graph signal. Besides, the factor 
1/(1 - 7) in ([^ implies that a smaller Cmax, which leads to a smaller 7, also reduces the 
error bound. A roughly calculation can be given to balance the two factors. If there are 
not too many vertices in each A/^, we have that Gmax approximates to A^max, where A^max is 
the largest cardinality of centerless local sets. Since A^max|T| approximates to A^, we have 

^_ 

1 7 1 \/loN [nax max 
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Table 2 : A greedy method to partition centerless local sets with maximal cardinality. 


Input: Graph Q(V,£), Maximal cardinality A^max; 

Output: Centerless local sets {Afijiez', 

Initialization: i = 0; 

Loop Until: V = 0 

1) Find one vertex with the smallest degree in Q, 

u — dzgm.uidg{v)] 
vev 

2) i = i + 1, Mi ^ { m }; 

3) Obtain the neighbor set of Mi, 

= {t- e Q\v ^ w,w e Mi,v ^ Mi}-, 

Loop Until: IVI = -^max or = 0 

4) Find one vertex with the smallest degree in Si, 

u = arg min dg (v ); 

veSi 

5) M 

6) Update 5^ = {?; G Q\v ^ w^w ^ A/^, v ^ A/^}; 

End Loop 

7) Remove the edges, S = £\{{p^ q)\p ^ A/^, q G V}; 

8) Remove the vertices, V = V\Ni and Q = QiV^E)] 

End Loop 


To minimize the above quantity, a near optimal 

1 


IS 


AUia,x — 


2 ^’ 


(18) 


i.e., 7 approximates to 1/2. It provides a strategy to partition centerless local sets. For 
given cutoff frequency cj, an approximated A^max can be chosen according to (18), then 
the graph is divided into local sets to make sure that \J\fi\ is not more than A^max and the 
number of local sets is as small as possible. 

For a given A^max, a greedy algorithm is proposed to make the division of centerless local 
sets, as shown in Table The greedy algorithm is to iteratively remove connected vertices 
with the smallest degrees from the original graph into the new set, until the cardinality 
of the new set reaches A^max or there is no connected vertex. The reason for choosing the 
smallest-degree vertex is that such a vertex is more likely on the border of a graph. 
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6 Experiments 


We choose the Minnesota road graph [35!, which has 2640 vertices and 6604 edges, to verify 
the proposed generalized sampling scheme and reconstruction algorithm. The bandlimited 
signals for reconstruction are generated by removing the high-frequency component of ran¬ 
dom signals, whose entries are drawn from i.i.d. Gaussian distribution. The centerless local 
sets are generated by the greedy method in Table [fusing given A^max- Five kinds of local 
weights are tested including 

1. uniform weight, where (^i{v) equals l/\J\fi\yv G Mi] 

2 . random weight, where 

Vi{v) ^ ^ 

3. Dirac delta weight, where (^i equals 5u for a randomly chosen u G Mi] 

4. the optimal weight, where 

(cj^ {v \) 

^ - ) 2 . Vv G V; 

5. the optimal Dirac delta weight, where (fi equals Su for 

u — arg min 

Notice that case 3) and case 5) degenerate ILMR to IPR. 

6.1 Convergence of ILMR 

In the first experiment, the convergence of the proposed ILMR is verified for various center¬ 
less local sets partition and local weights. The graph is divided into 709 and 358 centerless 
local sets for A^max equals 4 and 8 , respectively. Three kinds of local weights are tested 
including case 1), 2), and 3). The averaged convergence curves are plotted in Fig. for 
100 randomly generated original graph signals. According to Fig. the convergence is 
accelerated when the graph is divided into more local sets and has a smaller A^max- It is 
ready to understand because more local sets will bring more measurements and increase the 
sampling rate, which provides more information in the reconstruction. According to 
for the same cj, a smaller A^max leads to a smaller 7 , and guarantees a faster convergence. 
The experimental result also shows that in the noise-free scenario, reconstruction with uni¬ 
form weight converges slightly faster than that with random weight. However, both above 
cases converge much faster than reconstruction with Dirac delta weight. This means that 
local-measurement-based ILMR behaves better than decimation-based IPR by combining 
the signals on different vertices properly. 
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Figure 3: The convergence behavior of ILMR for various division of centerless local sets and 
different local weights. 


6.2 Optimal Local Weights for Gaussian Noise 

In this experiment, independent zero-mean Gaussian noise is added to each vertex with 
different variance. The original signal is normalized with unit norm. All of the vertices are 
randomly divided into three groups with the standard deviations of the noise chosen as a 
equals 1 x 10“^, 2 x 10“^, and 5 x 10“^, respectively. The graph is partitioned into 358 
centerless local sets with A^max equals 8. Three kinds of local weights are tested including 
case 1), 4), and 5). The averaged convergence curves are illustrated in Fig. for 100 
randomly generated original graph signals. One may read that the steady-state relative 
error with the optimal weight is smaller than those with uniform weight and the optimal 
Dirac delta weight. The experimental result verifies the analysis in section [5^ It implies 
that a better selection of local weights can reduce the reconstruction error if the noise 
variances on vertices are different. 

6.3 Performance against Independent and Identical Distributed Gaussian 
Noise 

In this experiment, the performance of the proposed algorithm against i.i.d. Gaussian noise 
are tested for three kinds of local weights including case 1), 2), and 3). In this case the 
optimal local weights is equivalent to uniform weights. The graph is partitioned into 358 
centerless local sets with A^max equals 8. The relative reconstruction errors of three tests 
are illustrated in Fig. Each point is the average of 100 trials. The experimental result 
shows that for i.i.d. Gaussian noise, reconstruction with uniform weight or random weight 
performs beyond that with Dirac delta weight, which is actually the traditional sampling 
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Figure 4: The convergence curves of reconstruction with uniform weights, the optimal 
weights, and optimal Dirac delta weights when independent zero-mean Gaussian noise is 
added to each vertex. 


scheme of decimation. It shows that compared with decimation, the proposed generalized 
sampling scheme is more robust against noise, as analyzed in section 

6.4 Reconstruction of Approximated Bandlimited Signals 

In this experiment, approximated bandlimited signals are tested to be reconstructed by 
ILMR. The original signal is normalized to have norm 1 and the out-of-band energy is 10“^ 
or 10“^. The graph is partitioned into 358 centerless local sets and the maximal cardinality 
of local sets is 8. Three kinds of local weights are tested including case 1), 2), and 3). The 
convergence curves are shown in Fig. where each curve is the average of 100 trials. It is 
natural to see that the steady-state error is larger for a larger out-of-band energy. Besides, 
the case with uniform local weights has a smaller relative error, much better than that with 
Dirac weights. In other words, reconstruction from local measurements performs beyond 
reconstruction from decimation if the original signals are not strictly bandlimited. 

7 Conclusion 

In this paper, a sampling scheme named local measurement is proposed to obtain sampled 
data from graph signals, which is a generalization of graph signal decimation. Using the 
local measurements, a reconstruction algorithm ILMR is proposed to perfectly reconstruct 
original bandlimited signals iteratively. The convergence of ILMR is proved and its per¬ 
formance in noise scenario is analyzed. The optimal local weights are given to minimize 
the effect of noise, and a greedy algorithm for local sets partition is proposed. Theoretical 
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Figure 5: Relative errors of ILMR under difference SNRs with various choices of local 
weights. The noise associated with each vertex is i.i.d. Gaussian. 


analysis and experimental results demonstrate that the local measurement sampling scheme 
together with reconstruction method is more robust against additive noise. 


8 Appendix 

8.1 Proof of Lemma [T] 

By the definition of G, and considering that {A/i}ieX are disjoint, one has 


If - Gfir = 


< 




iex 




where 




/(n), neA/i; 

0 , V ^ Mi- 


(19) 
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Figure 6: The convergence curves for uniform weights, random weights, and Dirac delta 
weights if the original graph signals are approximated bandlimited. 


For i G X, one has 


i|fM 


veAfi 

veJ\fi peJ\fi 


2 


f{p)) 


- Y1 - f(p)\‘^ 


( 20 ) 


Denote 

Pi{v) = argmax !/(?;) - /(p)p. 

peK 

Since J\fi is connected, there is a shortest path within J\fi from v to Pi{v)^ which is denoted 
as 'u ^ 'L’l ^ ^ ^ Pi{v)^ and the length of this path is not longer than Di. Then for 

V G A/i, one has 


mi« |/(^;) - /(p)P = \ f{v) - f{pi{v))f < {\f{v) - f{vi)\ + • • • + \f{vkj - f{pi{v))\f 

P^J\i 

<Di {\f{v) - f{vi)\‘^ + • • • + \fivkj - fiPi{v))\‘^) . 


Therefore, one has 




veN'i 


( 21 ) 


pr^q]p,qeMi 


where p ^ q denotes there is an edge between p and q. Inequality (21) holds because each 
edge within J\fi is reused for no more than \J\fi\ times. To study the right hand side of (21), 
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one has 


I] \f{p) - /(?)!" =f^Lf = f^UAU^f = FAf 


p-^q 


( 22 ) 


Xi<(jj 


where L,U, and A denote the Laplacian, its eigenvectors, and its eigenvalues, respectively. 
The last inequality in (22) is because the entries of spectrum f = U^f corresponding to the 


frequencies higher than cj are zero for f G PWu;{G). 

Consequently, utilizing (20), (21), and ( [^ in ( [T^ , we have 


if-Gff (iviA i/(F-/(^)P 

iex \ 

|2 






^^C'maxl 


and Lemma is proved. 

8.2 Proof of Proposition 

According to Lemma we have ||I — G|| < 7 < 1 for PWoj{G) when 7 = Cmaxv^ < 1 - 
Then G is invertible and 1 —7< ||G|| < I + 7 for PW^{G)- The inverse of G is 

00 

G-‘ = 5^(1 - G)^. 

J =0 

According to ([^, f can be written as 

00 

f = G-'Gf = ^(I - G)^' ^(f, <p^)VUSMJ = ^(f, <P^)e^, (23) 

j—0 i^X i^X 

where 

00 

j=0 

Similarly, one has 

f = <Pi)ei. 

iex 

Using ^ and = Gf, we have 

f(U = f + (I _ G)^(f(°) - f) = f - (I - G)^+^f. 
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Therefore 


f(^=) = f - (I - G)'=+if = 5](f, <fi)ei - (I - G)''+if. 

iex 

If 7 = Cmaxv^ < I 5 satisfies 

00 

iie.ii < Eviipuv.)ii < r^iiv.ii = 

^ i — 7 i — 7 


j=0 


According to (23), (24), and (25), 


iif('‘i - f II= 




< 5]|(n,<-\l IIE.II 1 


l|ei|| +7 


< 


iex 

1 


j 


|M|-KI + 7'^+'(l|f|| + l|n|| 


i^X 


(24) 


(25) 


Then Proposition is proved. 


References 

[1] D. L Shuman, S. K. Narang, P. Frossard, A. Ortega, and P. Vandergheynst, “The emerging field of 
signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular 
domains,” IEEE Signal Process. Mag.^ voL 30, no. 3, pp. 83-98, 2013. 

[2] A. Sandryhaila, and J. M. F. Moura, “Big data analysis with signal processing on graphs: Representation 
and processing of massive data sets with irregular structure,” IEEE Signal Process. Mag., vol. 31, no. 5, 
pp. 80-90, 2014. 

[3] X. Zhu and M. Rabbat, “Graph spectral compressed sensing for sensor networks,” in Proc. 37th IEEE 
Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2012, pp. 2865-2868. 

[4] A. Gadde, A. Anis, and A. Ortega, “Active semi-supervised learning using sampling theory for graph 
signals,” in Proc. 20th ACM Int. Conf. Knowledge Discovery and Data Mining (KDD’14), 2014, pp. 
492-501. 

[5] Z. Yang, A. Ortega, and S. Narayanan, “Gesture dynamics modeling for attitude analysis using graph 
based transform,” in Proc. 21st IEEE Int. Conf. Image Process. (ICIP), pp. 1515-1519, 2014. 

[6] S. Ghen, F. Gerda, et ah, “Semi-supervised multiresolution classification using adaptive graph filtering 
with application to indirect bridge structural health monitoring,” IEEE Trans. Signal Process., vol. 62, 
no. 11, pp. 2879-2893, 2013. 

[7] A. Sandryhaila, and J. M. F. Moura, “Discrete signal processing on graphs,” IEEE Trans. Signal Process., 
vol. 61, no. 7, pp. 1644-1656, 2013. 

[8] S. Ghen, A. Sandryhaila, J. M. F. Moura, and J. Kovacevic, “Adaptive graph filtering: Multiresolution 
classification on graphs,” in Proc. 1st IEEE Clohal Conf. Signal and Inform. Process. (ClobalSIP), 2013, 
pp. 427-430. 

[9] R. R. Goifman and M. Maggioni, “Diffusion wavelets,” Appl. Comput. Harmonic Anal, vol. 21, no. 1, 
pp. 53-94, 2006. 


22 













[10] D. K. Hammond, P. Vandergheynst, and R. Gribonval, “Wavelets on graphs via spectral graph theory,” 
AppL Comput. Harmonic Anal, voL 30, no. 2, pp. 129-150, 2011. 

[11] S. K. Narang and A. Ortega, “Perfect reconstruction two-channel wavelet filter-banks for graph struc¬ 
tured data,” IEEE Trans. Signal Process.^ vol. 60, no. 6, pp. 2786-2799, 2012. 

[12] X. Zhu and M. Rabbat, “Approximating signals supported on graphs,” in Proc. 37th IEEE Int. Conf. 
Acoust., Speech, Signal Process. (ICASSP), 2012, pp. 3921-3924. 

[13] H. Q. Nguyen, M. N. Do, “Downsampling of signals on graphs via maximum spanning trees,” IEEE 
Trans. Signal Process., vol. 63, no. 1, pp. 182-191, 2015. 

[14] A. Agaskar, and Y. M. Lu, “A spectral graph uncertainty principle,” IEEE Trans. Inform. Theory, vol. 
59, no. 7, pp. 4338-4356, 2013. 

[15] P. Liu, X. Wang and Y. Gu, “Goarsening graph signal with spectral invariance,” in Proc. 39th IEEE 
Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2014, pp. 1075-1079. 

[16] P. Liu, X. Wang, and Y. Gu, “Graph signal coarsening: Dimensionality reduction in irregular domain,” 
in Proc. 2nd IEEE Global Conf. Signal and Inform. Process. (GlobalSIP), 2014, pp. 966-970. 

[17] V. N. Ekambaram, G. G. Fanti, B. Ayazifar, and K. Ramchandran, “Multiresolution graph signal 
processing via circulant structures,” in Proc. IEEE Digital Signal Process., Signal Process. Educ. Meeting 
(DSP/SPE), 2013, pp. 112-117. 

[18] D. 1. Shuman, M. J. Faraji, and P. Vandergheynst, “A framework for multiscale transforms on graphs,” 
arXiv preprint arXiv:1308.4942, 2013. 

[19] D. Thanou, D. 1. Shuman, and P. Frossard, “Parametric dictionary learning for graph signals,” in Proc. 
1st IEEE Global Conf. Signal and Inform. Process. (GlobalSIP), 2013, pp. 487-490. 

[20] X. Dong, D. Thanou, P. Frossard, and P. Vandergheynst, “Learning graphs from signal observations 
under smoothness prior,” arXiv preprint arXiv:1406.7842, 2014. 

[21] A. Anis, A. Gadde, and A. Ortega, “Towards a sampling theorem for signals on arbitrary graphs,” in 
Proc. 39th IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2014, pp. 3892-3896. 

[22] S. K. Narang, A. Gadde, E. Sanou, and A. Ortega, “Localized iterative methods for interpolation in 
graph structured data,” in Proc. 1st IEEE Global Conf. Signal and Inform. Process. (GlobalSIP), 2013, 
pp. 491-494. 

[23] X. Wang, P. Liu, and Y. Gu, “Iterative reconstruction of graph signal in low-frequency subspace,” in 
Proc. 2st IEEE Global Conf. Signal and Inform. Process. (GlobalSIP), pp. 611-615, 2014. 

[24] X. Wang, P. Liu, and Y. Gu, “Local-set-based graph signal reconstruction,” to appear in IEEE Trans. 
Signal Process, available at arXiv:1410.3944^ 2014. 

[25] X. Wang, M. Wang, and Y. Gu, “A distributed tracking algorithm for reconstruction of graph signals,” 
to appear in IEEE J. Selected Topics Signal Process, available at arXiv:1502.0297, 2015. 

[26] S. Ghen, A. Sandryhaila, J. M. F. Moura, and J. Kovacevic, “Distributed algorithm for graph signals,” 
in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Brisbane, Apr. 2015. 

[27] S. K. Narang, A. Gadde, and A. Ortega, “Signal processing techniques for interpolation in graph 
structured data,” in Proc. 38th IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2013, pp. 
5445-5449. 

[28] 1. Pesenson, “Sampling in Paley-Wiener spaces on combinatorial graphs,” Trans. Amer. Math. Soc., 
vol. 360, no. 10, pp. 5603-5627, 2008. 

[29] H. Fiihr and 1. Z. Pesenson, “Poincare and Plancherel-Polya inequalities in harmonic analysis on 
weighted combinatorial graphs,” SIAM J. Discrete Math., vol. 27, no. 4, pp. 2007-2028, 2013. 

[30] F. Marvasti, Nonuniform Sampling: Theory and Practice, Springer, 2001. 


23 


[31] H. G. Feichtinger, and K. Grochenig, “Theory and practice of irregular sampling,” Wavelets: Math, 
and Applieat., pp. 305-363, 1994. 

[32] K. Grochenig, “A discrete theory of irregular sampling,” Linear Algebra and Its Applieat., vol. 193, pp. 
129-150, 1993. 

[33] K. Grochenig, “Reconstruction algorithms in irregular sampling,” Math. Comput.^ vol.59, no. 199, pp. 
181-194, 1992. 

[34] A. Aldroubi, “Non-uniform weighted average sampling and reconstruction in shift-invariant and wavelet 
spaces,” Appl. Comput. Harmonie Anal, vol. 13, no. 2, pp. 151-161, 2002. 

[35] I. Pesenson, “Poincare-type inequalities and reconstruction of Paley-Wiener functions on manifolds,” 
J. Geometrie Anal, vol. 14, no. 1, pp. 101-121, 2004. 

[36] H. Feichtinger and I. Pesenson, “Recovery of band-limited functions on manifolds by an iterative algo¬ 
rithm,” Contemporary Math., vol. 345, pp. 137-152, 2004. 

[37] F. R. K. Ghung, Speetral Graph Theory, Amer. Math. Soc., 1997. 

[38] M. W. Lipsey and D. B. Wilson, Praetieal Meta-analysis. Thousand Oaks, GA: Sage publications, 2001. 

[39] D. Gleich, The MatlabBGL Matlab Library [Online]. Available: 

http: / / WWW. cs. purdue. edu/homes / dgleich/packages / matlab _bgl / index. ht ml 


24 


